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4.2.2 Exponential Distribution 

The exponential distribution is one of the widely used continuous distributions. It is often used to model the time elapsed between events. We 
will now mathematically define the exponential distribution, and derive its mean and expected value. Then we will develop the intuition for the 
distribution and discuss several interesting properties that it has. 


A continuous random variable X is said to have an exponential distribution with parameter A > o, shown as 
X ~ Exponential if its PDF is given by 



x > 0 

otherwise 


Figure 4.5 shows the PDF of exponential distribution for several values of A. 
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It is convenient to use the unit step function defined as 


u(x) 


1 X > 0 


0 otherwise 

so we can write the PDF of an Exponential^ A) random variable as 

fx(x) = Xe~ Xx u(x). 

Let us find its CDF, mean and variance. For X > 0, we have 


Fx(x)= f 
Jo 


\ e - xt dt = 1 -e~ Ax . 


So we can express the CDF as 

F x {x) = (l - e~ Xx )u(x). 

Let X ~ Exponential(X). We can find its expected value as follows, using integration by parts: 

EX = f 0 °° x\e- Xx dx 

= j ye~ v dy choosing y = Xx 


— e y — ye y 


Now let's find Var( X) . We have 


EX 2 = r x 2 Xe Xx dx 

^ JT y 2e V(i v 


2e- y -2ye- y -y 2 e~ y 


J 0 


Thus, we obtain 


Va,(X) = EX 2 - (EX) 2 = 


IfX ~ Exponential(X), then EX = y andVar(X) = 


An interesting property of the exponential distribution is that it can be viewed as a continuous analogue of the geometric distribution. To see 
this, recall the random experiment behind the geometric distribution: you toss a coin (repeat a Bernoulli experiment) until you observe the first 
heads (success). Now, suppose that the coin tosses are A seconds apart and in each toss the probability of success is p = A A. Also suppose 
that A is very small, so the coin tosses are very close together in time and the probability of success in each trial is very low. Let X be the 
time you observe the first success. We will show in the Solved Problems section that the distribution of X converges to Exponential (A) 
as A approaches zero. 

To get some intuition for this interpretation of the exponential distribution, suppose you are waiting for an event to happen. For example, you 
are at a store and are waiting for the next customer. In each millisecond, the probability that a new customer enters the store is very small. You 
can imagine that, in each millisecond, a coin (with a very small P(H )) is tossed, and if it lands heads a new customers enters. If you toss a 
coin every millisecond, the time until a new customer arrives approximately follows an exponential distribution. 

The above interpretation of the exponential is useful in better understanding the properties of the exponential distribution. The most important 
of these properties is that the exponential distribution is memoryless. To see this, think of an exponential random variable in the sense of 
tossing a lot of coins until observing the first heads. If we toss the coin several times and do not observe a heads, from now on it is like we start 
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all over again. In other words, the failed coin tosses do not impact the distribution of waiting time from now on. The reason for this is that the 
coin tosses are independent. We can state this formally as follows: 


P(X > x + a\X > a) = P(X > x). 



From the point of view of waiting time until arrival of a customer, the memoryless property means that it does not matter how long you have 
waited so far. If you have not observed a customer until time CL, the distribution of waiting time (from time CL) until the next customer is the 
same as when you started at time zero. Let us prove the memoryless property of the exponential distribution. 


P(X > x + a\X > a) 


P{X > x + a, X > a) 
P(X > a) 

P(X > x + a) 

P(X > a) 

1 - F x {x + a) 

1 ~ Fx (a) 

e -A (s+o) 



= P(X > x). 
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